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Abstract — We study incremental redundancy hybrid ARQ (IR- 
HARQ) schemes based on punctured, finite-length, LDPC codes. 
The transmission is assumed to take place over time varying 
binary erasure channels, such as mobile wireless channels at the 
application layer. We analyze and optimize the throughput and 
delay performance of these IR-HARQ protocols under iterative, 
message-passing decoding. We derive bounds on the performance 
that are achievable by such schemes, and show that, with a simple 
extension, the iteratively decoded, punctured LDPC code based 
IR-HARQ protocol can be made rateless and operating close 
to the general theoretical optimum for a wide range of channel 
erasure rates. 

Index Terms — HARQ, incremental redundancy, rateless codes, 
throughput vs. delay tradeoff, LDPC codes, puncturing, BEC. 



I. Introduction 

In communications networks today, transmissions almost 
always take place over time varying channels, because of, for 
example, the channel's physical nature (e.g., wireless) or the 
length of a session (e.g., downloading a large file). Traditional 
channel coding schemes are inadequate in such circumstances 
because they have fixed redundancy matching only a particular 
channel condition. Similar problems arise in transmission 
to multiple users over (non)varying but different channels. 
Several recently proposed and/or implemented coding schemes 
address the time varying and multiuser communication sce- 
narios, such as hybrid ARQ on the physical layer and Raptor 
codes on the applications layer. 

Hybrid ARQ transmission schemes combine conventional 
ARQ with forward error correction. A scheme known as 
incremental redundancy hybrid ARQ (IR-HARQ) achieves 
higher throughput efficiency by adapting its error correcting 
code redundancy to varying channel conditions. Because of 
that, the scheme has been adopted by a number of standards 
for mobile phone networks. IR-HARQ is considered to be one 
of the most important features of the CDMA2000 lxEV-DO 
Release and Revision A systems HI > El- A historic overview 
of HARQ schemes, up to 1998, can be found in Q. For 
a survey of more recent developments, we direct the reader 
to J31 and references therein. In the third generation wireless 
standards, the IR-HARQ scheme resides in the physical layer 
and operates over time varying fading channels. The scheme 
is based on a turbo code dating back to the IS-95 standard. A 
possible replacement of this code by an LDPC or a fountain 
code was considered in (5)- 

Fountain codes are primarily designed to operate over era- 
sure channels. They have superior performance in applications 
in which the channel variations are large and/or cannot be 
reliably determined a priori. Because of this robustness, some 



classes of Fountain codes have been adopted into multiple 
standards, such as within the 3GPP MBMS standard for 
broadcast file delivery and streaming services, the DVB-H 
IPDC standard for delivering IP services over DVB networks, 
and DVB-IPTV for delivering commercial TV services over 
an IP network, and are presently being considered for imple- 
mentation in LTE eMBMS. 

We here consider a hybrid ARQ scheme based on punctured 
LDPC codes over the BEC channel. LDPC codes have been 
chosen as an instance of capacity-approaching codes. They 
are theoretically well understood, and popular in practice 
not only because of their error/erasure rate performance, but 
also because they have simple encoders and decoders. In this 
particular application, capacity approaching LDPC codes are 
of interest because they can be punctured, as explained in 
0, s.t. the resulting punctured ensemble is also capacity 
approaching. Most of developed results can be easily extended 
to other punctured sparse-graph codes. 

The performance of the HARQ scheme is measured by the 
throughput and the delay from the beginning of the coded data 
transmission until the moment when the information has been 
successfully decoded. The goal is to have high throughput 
and low delay, but only a certain tradeoff between these two 
quantities is attainable, and finding it is the central question in 
analyzing HARQ schemes. One of our goals is to characterize 
the tradeoff between the average throughput and the average 
delay, and to show how to run an HARQ scheme to achieve 
various operating points. Note that the average throughput 
and the average delay have been intensively investigated. 
However, the obtained results only give bounds, either under 
the maximum-likelihood decoding assumption (e.g. |5j, Q), 
or under (more practical) iterative decoding but based on the 
bit error probability (e.g. O), which means that the bound 
is tight only for large code lengths. The approach taken in 
this paper is based on the block error performance under 
iterative decoding, and we use the finite-length scaling results 
on punctured LDPC code ensembles, as developed in J9|. We 
also show how our LDPC codes based IR-HARQ scheme can 
be made rateless. 

The main contribution of this work are as follows: (i) We 
derive tight approximations of the average throughput and 
delay as functions of certain parameters of the used code 
ensemble and of the considered IR-HARQ scheme; (ii) We 
show how to chose these parameters in order to optimize both 
the throughput and the delay; (iii) We propose a rateless-like 
IR-HARQ scheme, based on LDPC codes, and derive tight 
bounds of its average throughput and delay. 

This paper is organized as follows: In Sec. [TT1 we describe 
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our IR-HARQ scheme and present expressions for its average 
throughput and delay. In Sec. [HI] we define the finite-length 
rate-compatible LDPC codes used further in the paper. Section 
IIII-CI presents a model of the IR-HARQ scheme based on 
LDPC codes. In Sec. [IV] we define the optimization problem 
to determine the best code and protocol parameters. Section 
[V] presents a modification of the IR-HARQ scheme based on 
LDPC codes, enlarging its working region, and the comparison 
of the modified scheme with the HARQ scheme, based on LT 
codes. At the end, in Sec lVIl we then discuss our observations 
and some possible extensions. 

II. Incremental Redundancy Hybrid ARQ Model 
A. Multiple Transmissions Protocol and Channel Model 

We analyze a particular retransmission protocol called In- 
cremental Redundancy Hybrid ARQ (IR-HARQ), with the 
following multiple transmission model of ifTOl . ifTTl : at the 
transmitter, the user data bits are encoded by a low rate code, 
referred to as the mother code. Initially, only a selected number 
of encoded bits are transmitted, and decoding is attempted at 
the receiving end. If decoding fails, the transmitter, notified 
through the feedback, sends additional encoded bits, thus 
incrementing the redundancy. Besides the information about 
the success/failure of the transmission, the feedback may 
also carry the channel erasure rate information, to help the 
transmitter decide to which extent to increment the redun- 
dancy. Upon completion of the new transmission, decoding is 
again attempted at the receiving end, where the new bits are 
combined with those previously received. 

The described procedure is repeated after each subsequent 
transmission request until all the encoded bits of the mother 
code are transmitted. The channel is modeled as a time-varying 
BEC such that the channel erasure probability during the 
transmission of one block of encoded bits is constant and 
changes from one block transmission to another. We denote 
the channel erasure probability for transmission m as e m . That 
the channel erasure probability does not change during the 
transmission of one block is a reasonable assumption as the 
block transmission duration is usually chosen to be smaller 
than the coherence time of the transmission channel. This 
approach is used further in the paper, namely in Section HV-AI 
when the maximum number of transmissions is chosen. 

The main design parameters of the IR-HARQ scheme are 
iflOl . |[TTll : the maximum possible number M of transmissions 
for one block of user data and the fractions q m , m = 1,M, 
of encoded bits assigned to transmission m. The maximum 
number of transmissions M is usually predefined by the 
protocol, while the fractions q m 's can be either predefined 
or calculated before each transmission, taking into account 
the feedback information about the previous channel erasure 
rates. 

To analyze the IR-HARQ scheme, we adopt a probabilistic 
model in which the g m 's are seen as probabilities, i.e., 
in which the transmitter assigns a bit to transmission m 
with probability q m . Clearly, the transmitter has also the 
constraint (known as rate compatible puncturing) to assign 
to transmission m only those bits which have not been 



assigned to any of the previous transmissions. Even with this 
probabilistic model it is possible to make the scheme rate 
compatible as follows ifTUl : 

START 

Before the IR HARQ protocol starts 

1) For each encoded bit, generate a number 6 V indepen- 
dently and uniformly at random over [0, 1). 

2) Determine M and q\ (or all the q m 's if necessary) 

3) Compute p\ as pi = 1 — q\. 

4) Each bit s.t. 9 V > p\ is assigned to transmission 1. 

If transmission m — 1 fails for 2 < m < M — 1 

1) Determine q m (if not yet determined). 

2) Compute p m as p m = p m -\ - q m . 

3) Each bit s.t. p m < 9 V < p m -\ is assigned to transmis- 
sion m. 

If transmission M — 1 fails 
transmit all remaining bits. 

END 

In the IR-HARQ transmission protocol above, the transmit- 
ter is assumed to have already accumulated some useful data 
to be sent, so the queuing process is not considered. 

In Section [IV] we determine how the q m 's are chosen. The 
criterion for such choice is to optimize the performance of the 
scheme, which is given by its throughput and delay. 

B. Performance Measures 

Two standard measures of ARQ protocol efficiency are the 
throughput and the delay, defined as follows. 

Definition 1: The throughput of a retransmission scheme is 
the number of user data bits accepted at the receiving end in 
the time required for transmission of a single bit. 

Definition 2: The delay of a retransmission scheme is the 
number of bits that must be transmitted in order to receive the 
useful information (user data bits). 

In what follows, we are interested by the average throughput 
r\ and the average delay r. We have the following lemma: 

Lemma 2.1: Consider an IR-HARQ scheme with at most 
M transmissions and a set of fractions qi, . . . , qm- Let the 
underlying mother code be of length n and of rate R. Denote 
by oo m the probability that it takes exactly m transmissions for 
the decoding to be successful. Then the average throughput rj 
and delay t are determined by following expressions 

M 

R U! m 



m— 1 j — 1 

M m 

nJ2 w m(X]%) 



m— 1 
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Proof: The probability that one of the m < M trans- 
missions is successful is Em=i UJm - B ecause our protocol is 
limited to M transmissions, if none of these transmissions 
is successful, the throughput is equal to 0. When one of 
the m < M transmissions is successful, the number of user 
data bits communicated to the receiver is Rn. The number of 
encoded bits sent to the receiver through the mth transmission 
is ^E^ift 1 So, the average throughput rj is given by ([T). 
The calculation for r is similar. ■ 
Remark 1: The expressions (Q]i for rj and © for t implicitly 
assume that the feedback from the receiver to the transmit- 
ter is instantaneous. In practice the delay of the feedback 
transmission is positive, and we can introduce it in the above 
expressions as follows. Let the transmission time of one bit in 
the forward direction be t\bit- Since the feedback propagation 
delay, i.e. the time interval between two transmissions, is t, it 
is equivalent to the time needed to transmit tt-ack = t/tibit bits 
in the forward direction. Then the expression for r becomes 



Em=l Ej Qj + E!=l m ^n 
n ~ , (3) 



where the term Em=i mu, m lS proportional to the av- 
erage feedback transmission delay. This term grows with the 
number of transmissions. On the other hand, note that the 
highest throughput can be achieved if the receiver is given a 
chance to attempt decoding upon receiving each additional bit, 
that is when M = n. 

The expression (ffj) for throughput becomes equal to its 
counterpart in (8) when q m = 1/M. The authors of fB] 
expressed the quantity uj m in terms of the probability P(m) 
that the asymptoticQ bit erasure rate Pb at transmission m 
goes to 0, i.e., P(m) « Prob[P b (m) ->• 0]. For LDPC 
codes, this probability has been computed with the help of 
density evolution. Clearly, P(m) is a lower bound on the 
failure probability at transmission m, which thus gives an 
upper bound on r) and a lower bound on r. We next derive 
expressions for these asymptotic bounds, while tighter bounds 
for finite length case will be presented in Section IIII-CI 

Consider an example of sparse-graph codes. A randomly 
chosen code from a sparse ensemble of length n has a 
successful iterative decoding with high probability when the 
channel erasure probability e is smaller than e^ n y where e* n ^ is 
the so called finite-length iterative decoding threshold. We will 
discuss e? n j for a particular case of LDPC codes in Section 
Hill Now we can state the following result: 

Theorem 1: Consider an IR-HARQ scheme based on a 
sparse-graph code of rate R and iterative decoding threshold 



-(n) 



The following bounds hold: 



< 



> 



R, 

.0, 



< e < e 
otherwise; 



(») 



0<e<6* n) ; 



1-e ' 

oo, otherwise. 



(4) 
(5) 



Proof: Consider the limiting case M = n (that is bit-by- 
bit transmission) since the highest throughput can be achieved 
if the receiver is given a chance to attempt decoding upon 
receiving each additional bit, that is when M = n. The 
smallest fraction of bits that are sufficient for successful 
decoding is 1 — eLv The channel with erasure probability 
e < passes on average a fraction of 1 — e bits unerased. 



O) 



bits on 



Hence, the smallest fraction 7 of coded bits to be sent by the 
transmitter in order to receive a fraction of 1 
average is 

1 — e* 

„, - (") 



'i.e., when the codelength n — > 00. 



Note that ?/ < -R/7, and follows immediately. 

Now consider the case when AI = 1 and n — > 00. At least 
771 bits should be sent to ensure successful decoding. Hence, 
t > 771 and <(5j follows. ■ 

The derived bounds are illustrated for an example LDPC 
ensemble in Fig. 03 

III. Performance of (Punctured) Finite-Length 
LDPC Codes over the BEC 

As we have seen above, the performance of the IR-HARQ 
scheme depends on the decoding performance after each trans- 
mission. We assume that the mother code is an LDPC code. 
We will see later that the performance after each transmission 
in this case is related to the decoding performance of the 
punctured mother code. First let us define the mother code 
and describe the puncturing technique. 

A. The Mother Code and Puncturing 

The mother code is taken at random from an irregular 
length-n, LDPC code ensemble, defined by its degree distri- 
butions X(x) = J2i ^i x% an d p( x ) = Ej Pi^ll Each code in 
the ensemble corresponds to a different Tanner graph, having 
Xi fraction of edges incident to variable nodes of degree i 
and pj fraction of edges incident to check nodes of degree j 
respectively. 

A code taken at random from an ensemble of (A, /?)-LDPC 
codes has, with high probability, a bit error probability close 
to the average bit error probability Pb of the ensemble. We 
will refer to this property as concentration. This property 
implies the concentration of the block error probability Pb for 
the so called waterfall region of channel parameters, within 
which Pb oc P^. The concentration property allows us to 
only consider the average performance of an LDPC ensemble 
(instead of looking at the performance of a particular code) 
by using the ensemble average analysis techniques. 

The performance of iterative decoding averaged over the 
LDPC ensembles is well understood when n is sufficiently 
large and when LDPC codes are used for a transmission over 
a channel with some fixed erasure rate e. Namely, as long as 
the channel erasure rate e is smaller than the threshold value 
e* given by 

e = mm — -. rr. 

»e(o,i] A(l - p(l - xj) 

2 We refer the reader unfamiliar with LDPC codes and their properties that 
we use below to the textbook 1121 . 
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and, even more importantly, it can be designed to conserve 
the concentration property, whereas random puncturing can- 
not. Therefore, in what follows we only consider intentional 
puncturing. 

A punctured LDPC ensemble of some length n is de- 
scribed by three polynomials: the degree distributions X(x) and 
p(x) mentioned before and the puncturing degree distribution 
p(x) = 'YliiPiX 1-1 , where the p^'s are the probabilities with 
which variable nodes of degree i are punctured. 

Notation 1: Let \ p (x) = '^2 i PiXix' l ~ 1 and 
K( x ) = _ Pi)X t x l ~ 1 = X(x) - X p (x). Using this 

notation, the asymptotic iterative threshold of such a punctured 
LDPC ensemble that was obtained in |9J, becomes 

■ Ap(l - p(l - x)) 



mm ■ 

r6(0,l] 



A P (1 

and its design rate is given by 



p(l-x)) 



R 




1 - 



(6) 



(7) 



Ei Ai/i 

where R is the code rate of the mother ensemble. 



Fig. 1 . Illustration of the upper bound on the region of attainable throughputs 
(top) and of the lower bound on the region of attainable delays (bottom) for 
an IR-HARQ scheme over a BEC(e), as shown in Thm. [T] The scheme is 



B. Finite-Length Performance 



We start with introducing some useful notation which we 
need to present finite-length performance of (punctured) LDPC 
codes. 

Notation 2: Note that the fraction of the variable nodes of 
degree i of a (A, p) LDPC ensemble is A, = iXi/Q^iiXi), 



based on a length-n LDPC code of rate R and iterative threshold e? ... The 1 < i < k We denote by A(x) = 2^2i the variable 



channels capacity line r/ m 
The delay at e = is to = n(l 



(n) 

1 — e is the maximum attainable throughput. 



c (n) 



the iterative message passing algorithm leads to vanishing bit- 
erasure probability as the number of iterations grows. 

Puncturing is a technique to obtain a code of a higher 
rate from a given code of some rate R. It simply means not 
transmitting (puncturing) a fraction of the encoded bits. The 
performance of the resulting code depends on the number and 
the choice of punctured bits. One way to make this choice 
is at random, depending on the outcome of tossing the same 
(biased) coin for each variable node. This way of puncturing 
is often called random puncturing. 

Another way to select the bits to puncture is to first choose 
the degree of the node to be punctured, according to a certain 
(optimized, degree biased) probability distribution, and then 
to select a node to puncture uniformly at random from all 
nodes with the chosen degree. This way of puncturing is often 
referred to as intentional puncturing. It has been shown iFPJI 
that intentional puncturing outperforms random puncturing, 



node degree distribution. Also, given the puncturing degree 
distribution p(x), let A p (x) — ~ Pi)A,a;* -1 . 

Notation 3: Finally, we introduce the following notation: 

y(x) = 1 - p(x), n(y) = eX p (y) + X p (y), 
£(x) - (n'(y) f(y)(p'(l) p'(x)), p{x) = 7r'(y)p'(x), 

where x = 1 — x and y = 1 — y. Here and further in the paper 
primes denote derivatives. 

The following conjecture from [9] will be further used: 

Conjecture 1: Assume transmission takes place over the 
BEC with erasure probability e using a code chosen at random 
from a punctured LDPC ensemble with length n and punctur- 
ing degree distribution p(x). Then, with high probability, the 
block erasure rate is tightly approximated by the following 
expression 



Pr 



Q 



o(l), 



(8) 



where Q(-) is the Q-error function and a and f3 are the scaling 
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and shift parameters, given by 
1 



V A'(l) \\ p (y*) 

2\ p (y*)p'(l-x*)(l-p(x*)) \ 
X p (y*)^-p'(x*) )' 

'-(-- b ~T= 

\A p (y*)x*p'(l - x*) ■ ^/-\ p {y*)n'{x*) t 
where x* satisfies ©, y* = y(x*), and 

\'(y*)y*-x*p'(l-x*) 



(9) 

2/3 

(10) 



6 = a:>'(l-a;*) 



(xv(i-^)r 



tt'V) + 



tt'(2/*) ^(y*) 



* V2 



?r(y*) v y* n{y*) 

x*(l - e*)p'(r) \ 2 -p/)A ;+ iy*('- 1 » 



y* / t(2/*) 

As we can see, a and /3 only depend on e*, x* and j/*, 
as well as on polynomials A, p and p. The justification for 
the conjecture follows the same line of reasoning as for the 
conjecture of the finite-length scaling law for unpunctured 
LDPC codes in (14\ . Note that the conjecture for unpunctured 
LDPC codes has been proven in lfl5ll for a particular case. 

Example 1 (Regular codes): For regular LDPC codes with 
parameters X(x) = x c and p(x) = x d , we have that p(x) = 
px c , where < p < 1. Moreover, the performance parameters 
become 



(11) 



1 — p 1 — p 1 — p 

where 6q, ao and /?o are the parameters of the corresponding 
unpunctured ensemble. 

Remark 2: For an LDPC code ensemble of length n, the 
finite-length iterative threshold c*,y already mentioned in 
Section mi is Ifl6| 

Note that, even for moderate lengths n, e? \ lies close to the 

6 («) 

asymptotic threshold e*. 

C. Equivalent Puncturing Model of the IR-HARQ Scheme 
Based on LDPC Codes 

Consider the IR-HARQ scheme described in Section [II] Its 
mother code is an LDPC code chosen at random from the 
ensemble of given length n, with degree distributions X(x) 
and p(x). Since it is irregular, the IR-HARQ scheme is now 
parametrized by the maximum number of transmissions M 
and the sequence of qij's and j = 1,M, where qtj denotes 
the probability with which a bit of degree i is chosen for 
transmission j. 

Recall that in Section UU only one value qj was assigned to 
transmission j. However, if the bits of an irregular code were 
chosen to be transmitted with probability qj regardless of their 
degree, this would correspond to random puncturing and the 
concentration property would be lost J5)- By introducing qij, 



for variable nodes of degee i and transmission j, we obtain the 
intentional puncturing scheme and preserve the concentration 
of the code performance around the average. 

From now on, we consider the puncturing model based on 
the qij's. Note that, for this case, the term Qj in expressions 
dU, (O and (O should be replaced by . \qi t j. 

The IR-HARQ protocol can be described with the help of 
the following equivalent punctured code model: the bits that 
the transmitter chooses to send through the m-th transmission 
can be equivalently seen as obtained by implementing a 
puncturing device that punctures a bit corresponding to a 
variable node of degree i with probability Pi m , where pi m = 
1 — Y^jLi Qij< or ' as shown within the protocol described in 
Section UTAl 

Pa = 1 - qn and pij = Pi(j-i) - Qij for 1 < j < M. (12) 

Further, assume that a transmission j takes place over the 
BEC with probability ej. When a bit corresponding to a 
variable node of degree i is assigned to one of the first m 
transmissions, it can be viewed as passing through the channel 
with average erasure ratejl {Y^Li 9« e j)/CfcLi 9ik)- So we 
can model the IR-HARQ protocol through transmission m as 
the transmission of the punctured mother code over a BEC 
with average erasure rate 



Em 
j = l 1ij e j 



Em 
fe=l* 



(13) 



where the considered bit is punctured with probability pi m . 

The IR-HARQ protocol outlined below implements our 
model while conforming to the rate compatible puncturing; 
it is based on the one introduced in Section III-AI 

Since the q, m 's are linked to the Pim's, the IR-HARQ 
performance can be determined from the performance of 
punctured versions of the mother code. We now determine 
the expected throughput and delay of the IR-HARQ scheme. 
Consider expressions (Q~|i and (fJJ. First we switch to the 
irregular case by replacing q m by 2~2i Next we describe 

how the u; m 's can be determined. 

Let A m denote the event of successful decoding after m 
transmissions, so A m denotes a decoding failure. Then 



0J„ 



Pmb(A r 



_!)Prob(A m |A 

m— 1 / 

_i) -Prob(i4 m )Prob(A m _i| J 4 r 



Assuming the BEC, Prob(A m _i|A m ) = 1. Note that 
Prob(A m ) = P ( ™\ where is the finite-length average 

block erasure rate Pg at transmission m. Remind that the 
expression for Pg is given by (0. Therefore, we have for u m 



P 



(m-l) 



B 



P. 



(to) 



(14) 



Note that ([Pil l is not valid for a more general type of 
transmission channel, where a subsequent transmission may 
result in a more noisy version of the codeword (whereas for the 
BEC, each subsequent transmission can only bring additional 
useful information). However, (Tufl i could still be used as an 



In this case, it is assigned to transmission j with probability 

«i/(Ete=i9«)- 
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approximation of ui m in a more general case. 

By using Conjecture Q] to approximate Pg in il4\ , one 
gets an approximation of r) and r for the IR-HARQ scheme. 
To support the use of Conjecture Q] we present here a figure 
from [11] that shows a good match of the approximation to 
numerical results. In Figure [2] the average throughput of the 
IR-HARQ scheme with M = 5, based on regular (x 2 ,x 5 ) 
LDPC codes of length 1024, is compared with its analytical 
approximation. 



v 0.8 — 
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0.1 0.2 0.3 0.4 

Fig. 2. Average throughput r\ versus equivalent channel erasure probability 
for (x 2 ,x 5 ) LDPC codes of length 1024. M = 5. Dotted line - numerical 
results, solid line - the analytical approximation. 



IV. Performance Optimization 

Using the proposed puncturing model, we aim to optimize 
the performance of the IR-HARQ transmission scheme based 
on LDPC codes by deciding which bits should be sent at 
each transmission. Note that, thanks to the concentration 
result for punctured LDPC codes, one has only to choose the 
mother LDPC code and the puncturing degree distributions for 
each transmission, without choosing a particular LDPC code 
and/or particular puncturing patterns. The concentration of the 
punctured LDPC ensemble ensures that the performance of a 
particular punctured LDPC code, picked at random from the 
designed ensemble, will be close to the average performance 
of this ensemble with high probability. Thus our optimization 
problem is only to chose how many bits on average should be 
sent in each transmission, rather than which exact bits. 

The performance measure that we choose to optimize are 
the average throughput r] and the average delay r. In previous 
sections, we have seen that, for finite-length schemes, rj has 
a staircase behavior, and thus it can be optimized point-wise, 
i.e., for some particular operating points on the e-axis, one 
optimizes r\ to obtain the maximum possible throughput for 
those points. 

We begin by assuming that the estimates of the erasure 
probabilities ci,...,cm are available at the transmitter. We 
also fix the acceptable block erasure probability P B M) after 
the maximum number of transmissions^ M and the feedback 

4 In practice, Pg is dictated by the supported application, i.e., image or 
voice transmission, video streaming, etc. 



propagation delay t. 

In the following section, we discuss the choice of other 
parameters that should be fixed before the optimization, 
namely: a) the maximum number of transmissions M, b) the 
codelength n, c) a fixed or maximum transmission block size 
K and d) the mother (A, p) LDPC code ensemble. Then we 
investigate how to choose the puncturing degree distribution 
for each transmission m, 1 < m < M, which leads us to 
design a rate-adaptable punctured LDPC ensemble, based on 
the initial (A, p) ensemble and then adapted to transmission 
conditions. Finally, we discuss how to obtain an estimate of 
erasure probabilities if they are not available at the transmitter. 

A. Choosing the Parameters (A, p), n, M and K 

In this section, we discuss how one should go about 
choosing the parameters X(x), p(x), n, M and K, which in 
general depends on the anticipated IR-HARQ application. The 
choice of degree distributions X(x) and p(x) of the mother 
LDPC ensemble determines the iterative decoding threshold 
e* and the code rate R of the ensemble, and consequently, an 
upper bound on the region of attainable throughputs versus 
transmission erasure probability. See Fig. [T]and Theorem Q] 

The upper bound on the region of attainable through- 
puts versus transmission erasure probability achievable when 
M —> n and n is sufficiently large. Clearly, for practical 
schemes, i.e., for small values of M and finite n of order 
of several hundreds/thousands of bits, the average throughput 
is smaller. However, if the degree distributions X(x) and p{x) 
are chosen in such a way that e* > max(ei, . . . , 6m) and the 
design rate R is sufficiently large, they can be good initial 
choices for finite-length performance optimization. Finally 
note that, if the desired block erasure probability P B is 
very low (e.g., 10~ 5 or lower, depending on the code), this 
imposes additional constraints on the minimum distance of the 
code ensemble, and hence on the degree distributions X(x) 
and p{x). Concerning these additional constraints, see, for 
example, fTTl . The choice of the codelength n depends on 
the desired value of P B , which should be attainable for the 
given e and the chosen (A, ,o)-pair. This can be verified using 
the finite-length analysis from (fl~8). 

The maximum number of retransmissions M should be 
chosen depending on a) the coherence time and b) the delay 
penalty. The coherence time Tc is the time during which 
the channel conditions are the same, and it depends on 
the transmission environment. Note that in our model the 
instantaneous erasure probability e m is assumed to be constant 
during the m-th transmission. Therefore, knowing tiuu we can 
transmit no more than bits in one transmission. From 
here we obtain that M > . Since the delay penalty 

is proportional to the total time of feedback transmissions 
needed to transmit a packet of data, to keep the delay penalty 
low one should choose M so that the time of one single 
transmission, proportional to jj, is large compared to the 
feedback propagation delay t. 

In practice, the number K of bits sent during one trans- 
mission is usually a constant, dictated by the transmission 
protocol. However, some applications may allow a variable 
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length for the transmission block. To cover both cases, we 
define K as the constant transmission block length in the first 
case and the maximum transmission block length in the second 
case. Most often, K is fixed and chosen to be K = -ff. 



B. Cost Function With a Feedback Penalty 

We next modify our optimization problem to address the 
case when the feedback transmission is not instantaneous 
but happens with some delay t. This delay introduces the 
feedback penalty into the IR-HARQ transmission, which can 
be accounted for in the average delay expression as explained 
by Remark Q] 

We start by defining a cost function, which needs to be 
optimized in order to increase the average throughput and 
to decrease the average delay. From <£TJ and (01, the average 
throughput and delay can be written as 

R w 
T] = r = nW, 



Wo' 



where 



Wo = — E[#(sent bits) | successful decoding, hack = 0] 



and 
W = 
Thus, 



and 



^E[#(sent bits) | successful decoding, hack 0]. 



W 



2^m=l U r> 



Ei j Kqij 



jL^m— 



"ack y^A' mu] 



W = W + 



E 



M 



Note that, having expressed -q and r in terms of the same 
function Wo, one can see that the average throughput is 
inversely proportional to the average delay. Moreover, if there 
is no feedback penalty, then W = Wo and there is no tradeoff 
between optimizing the throughput and the delay: one achieves 
both goals by minimizing Wo- In the general case, when 
W > Wo, either Wo or W can serve as the cost function for 
the optimization problem. By choosing Wo, one ensures the 
optimum choice of pi m coefficients to maximize the average 
throughput, and then W is chosen to minimize the average 
delay. Note that the solutions of two optimization problems, 
defined in terms of Wo and W, are close to each other if the 
value of tt-ack is small compared to n. 

From now on, we choose W as the cost function for the 
optimization problem. Using ( TT4T > and dT2b . W can be rewritten 



W 



(M)s 



™ACK 



M-l 



in terms of the pi/s and P B 

= r~^[ ((1 

1 B 

M-l 

- ^2 X iPH + X! Xi X! P B (Pirn ~ Pi(m+1)) 



pi M) ) 



m=0 



171 — 1 



Letting pj = ^ XiPij, we finally obtain 

M-l 



w = 



1 



1-p 



(M) 



^ACK 



B 
M-l 

rn — 1 



7n— 



(15) 



with P^™ 5 

given by (O for puncturing degree distribution 
p(x) = p m {x) and for the average channel erasure probability 
e = 8 m . Note that, following (1131) . the average erasure 
probability 5 m through transmission m is given by: 



, \ - , Ej(ft(j-i) -PiiY] 

d m - 2^ Ai — — 



(16) 



C. Optimization of Puncturing Degree Distributions 

Assuming the channel erasure probabilities ex, ... , 6m are 
known at the transmitter, the optimization problem reduces 
to optimizing the puncturing degree distributions p m {x) = 
J^iPimX 1 ^ 1 , 1 < m < M — 1, under the constraint of rate- 
compatibility, i.e. 

argmin^^M^ for V« and 1 < m < M — 1, 

given 1 > pa > p i2 > . . . > Pi(M-i) > PiM = 0. 

In general, this is a non-linear optimization problem, given 
that depends on the parameters e* n ,a m and fi rn , which 

themselves are dependent on the Pi m 's. We propose to use a 
gradient descent optimization algorithm to find a solution, as 
described below. 
START 

Initialization 
For m from 1 to M — 1, find initial puncturing fractions 
Pim's by assuming that the iterative threshold e* n , given by 
satisfies e*„ > e m . Moreover, the ftim's should satisfy 
one of the following conditions on K: 

*^2(Pi( m -l)-Pirn) = — Or y](Pi( m -l)-pim) < — (17) 

i i 

for constant or variable transmission block size, respectively. 
Choose the algorithm step size A max . 

Main part 

For m from 1 to M — 1, do the following iteration until the 
optimization process converges: 

1) Using ( fT3T l, compute W, given p im = p im , Vi. 

2) Find the A ?I „'s that minimize 



AW = 2^A m - {p im ) 

under the following constraints: 

a) Maximum changes: |Ai m | < A max 

b) Rate-compatibility: 

< Pim + A im < _pj( m _i), Vi 



(18) 
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c) Number of bits sent per transmission: 

^ y , (jPi(m— 1) Vim ^im) 



K 



K 



E{.Vi(m-l) ~ Vim — < , 



for constant or variable block size. 

3) Set Vim Vim ~l~ ^im- 

End of cycle over m. 
Final part 

Set the puncturing fractions equal to Pi m , V«,m. 
END 

Below are some details concerning the algorithm: 

• Initialization of Vim's and choice of A max : The initial 
values of the puncturing fractions are proposed to be 
set as if the LDPC code were of infinite length. This 
is an optimistic choice for the Pi m 's, since a finite-length 
code will behave worse than an infinite-length one with 
the same parameters. The fractions are found by linear 
programming: namely, one chooses puncturing fractions 
to maximize the code rate of the punctured ensemble, 
under the conditions of 1171 . For more details on the 
optimization procedure, see, for instance, ||T3l . Note that, 
for small m and high values of e, a solution may not exist. 
This means that the decoder will fail independently of the 
chosen puncturing fractions. In this case, any puncturing 
fractions can be chosen, assuming that they are rate- 
compatible with the optimized puncturing fractions for 
the later transmissions. Such an initial choice for the 
puncturing fractions ensures good convergence for the 
gradient descent algorithm, since it already lies close to 
an optimal solution (see Conjecture Q] and Remark |2). 
Hence, the algorithm step size A max should be chosen 
quite small, close to i. 



Minimization of \18V . 



' dw 

dpim 



is given by 



dW 



'(*), 



(M-l) 



d Pim ~ ~ cX f B 
{(**), 

with (*) = -cXi (2 - P ( g 



m = 1, 

m = M, (19) 
1 < m< AI, 



(VI + 



and 



(**) = -cmpIt 1 ' 

where c = (1 — Pb(M)) 1 is a constant, 



j(m) 



dPk 



dP 



(m) 



frl ■ exp{^{e* m 



Ann- 2 / 3 ) 2 } 



dpi 



d £*m _ 

a ^ 

OPim 



2tt< 

2/3 ®Pn 



dpr 



-2/3 



(20) 



and e* n , a rn and /3 m are parameters of the LDPC en- 
semble, punctured corresponding to the puncturing poly- 



nomial p m (x). 



and 



d/3„ 



can be found by taking 



the derivative of © and ( tlO) . and 



is obtained by 



implicit differentiation of the density evolution equation 

d e m _ ^iVm 1 ( x m ~ A(x m )) 
&Pim Ap(x m ) 2 

Remark 3: Note that the optimization problem based on Wo 
instead of W is defined in exactly the same way, except that 
the terms riACK/n will in dT9b will be zero. 

D. An Example of Optimization 

Now we consider a particular example of the optimization 
of an LDPC ensemble for a particular value of the channel 
average erasure probability e target . The initial parameters are: 
n = 2000, M = 5, P B {M) = 0.01 and K = n/M = 400, 
where the transmission block size K is constant. Denote by 
£max the maximum erasure probability that can be tolerated 
by the LDPC ensemble. We will choose ^target = 0.35 and 
tmax = 0.55 and optimize the throughput at e tar get = 0.35 
under the constraint that the iterative decoding threshold e* > 

^-max' 

The following degree distributions were chosen: X(x) = 
0.220813a; + 0. 353686a; 3 + 0.425502a; 12 and p(x) = 
0.390753x 4 + 0.361589a; 5 + 0.247658a; 9 . This gives rise to an 
LDPC ensemble with rate R = 0.37, e* = 0.608 (from ©) 
and P B (M = 5,n = 2000, e max ) « 0.009 (from ©). The 
optimized puncturing degree distributions at the initialization 
stage are 



Pi{x) = 0.6a;, 

p 3 {x) = 0.60264a; + 0.123057a; 3 4 
p 2 (x) = 0.735093x + 0.415371a; 3 



0.474303x 12 , 
h 0.649536x 12 , 



pi(x) = 0.867547a; + 0.707686a; 3 + 0824768a; 12 . 

We find that P^ — 1 for m < 2, i.e. after the first two 
transmissions a decoder will fail because of an insufficient 
number of transmitted bits, no matter what puncturing degree 
distributions are used. ^3(3;) and pa{x), however, are the 
best choices for the given initial parameters. Therefore, one 
needs to do at least 3 transmissions before starting to decode. 
Knowing this, we can send the first three coded packets one 
after another, without waiting for the feedback. 

For the initial-stage p(x)'s, the cost function W = 0.677. 
After the finite-length optimization, we obtain W = 0.646 
with the following new distributions pz(x) and ^4(3;): 

p 4 (x) = 0.1351a; + 0.4649a; 12 , 
p 3 (x) = 0.7351a; + 0.4649a; 12 . 

The average throughput, obtained using the described opti- 
mization procedure, is shown by the thick full line in Figure [3] 
The throughput with puncturing degree distributions obtained 
at the initialization stage is shown by the thick dashed line. 
Also, the thick dotted line represents the average throughput, 
obtained without any optimization by equally partitioning the 
bits of each degree i between transmissions. As we can see, 
the throughput at e target = 0.35 has indeed been improved. 

This example illustrates the interesting point that, in order 
to obtain a higher average throughput for some etarget, one 
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should not blindly send the bits with higher degrees first, 
trying to get the iterative decoder converge faster (which would 
seem intuitive), but instead find the optimal puncturing degree 
distributions for the given etarget- The reason is the following: 
if one of the first transmissions, carrying a large number of 
high degree bits, is unsuccessful, it will cause a large fraction 
of those bits to be erased, and many more transmissions will be 
needed in order to accumulate a sufficient number of unerased 
bits with lower degrees to make the decoder converge. 

Note that one can define an optimization problem for 
more than one target erasure probability, thus optimizing the 
throughput curve pointwise. Also note that the parameter K 
operates as a regulator of the number of transmissions. If 
the number of sent bits per packet were unbounded, there 
would be at most 2 transmissions - for the first transmission, 
the optimizer would decide to send as many bits as needed 
to ensure the target Pb at a given etarget, and, if the first 
transmission were unsuccessful, it would allocate the rest of 
the bits to transmission 2. 




0.4 

^target 

Fig. 3. Impact of the choice of p m (x)'s on the average throughput. The 
thin dotted line represents the theoretical limit, the thin full line - the upper 
bound given the mother LDPC code, the thick dotted line - no optimization, 
the thick dashed line - infinite-length optimization, the thick full line - finite- 
length optimization. 



E. The Regular Code Case 

In the case of regular LDPC codes, the scaling and shift 
parameters do not depend on the puncturing fraction p m . 
Indeed, based on Example [TJ it is easy to see that, for 
punctured regular codes, 

(m) _ n /^(e* - e(l- Pm ) - fin- 2 / 3 )" 



P 



(22) 



where e*, a and /3 are parameters of the initial unpunctured 
regular ensemble. Since Q(x) is an increasing function of its 
argument, Pg is a monotone increasing function in p m and 
the cost function W is minimized by the smallest possible 
values of p m , 1 < m < M, 



F. Estimating the e m 's at the Transmitter 

In general, the channel erasure probabilities e\, . . . , eu are 
not known at the transmitter and must be estimated before 



performing the optimization of the puncturing degree distribu- 
tions. The quality of estimation depends on the knowledge of 
the transmission channel statistics (mean, variance, probability 
distribution) and on the amount of feedback obtained at the 
transmitter (1 bit representing an ACK/NACK, the previous 
channel erasure probability,...). 

A wealth of literature is available on channel estimation. As 
examples, we list below a few possible approaches to channel 
estimation. 

> Known mean: Let the mean e of the channel erasure prob- 
ability be known at the transmitter. Then the puncturing 
degree distribution can be optimized as discussed above, 
assuming e m = e, m = 1, . . . , M — 1. 

• Known mean and previous erasure probabilities: Let the 
mean e of the channel erasure probability be known and 
assume the receiver sends to the transmitter the erasure 
probabilities ex, ... , e TO -i of the previous transmissions. 
In this case one can optimize the puncturing degree 
distributions in real time, i.e., just prior to transmission. 
At transmission 1, the transmitter sends the fraction of 
coded bits, optimized for e\ = e, since it does not 
have any feedback information. At transmission m > 1, 
however, the estimated erasure probability becomes 

m— 1 

e m = me- ^ e*. 

i=l 

• Known probability distribution and 1-bit feedback: As- 
sume that the probability density function p(e) is known 



and it has support [e min , e max ] 
sion m, we can estimate 

e TO = argmax ee[em . n>emiia: ] 
Pr(e = e m |ACK/NACKi, 



Then, for each transmis- 



,ACK/NACK m _i). 



Also note that, to ensure good performance, one should 
choose \{x) and p{x) in such a way that e* > e max . 

V. Rateless Incremental Redundancy Protocols 

A. Rateless Protocols Using Repetition 

As can be seen in Figure QJ the IR-HARQ protocols based 
on punctured codes achieve a high throughput only over a 
limited region of channel erasure rates. When they are based 
on iterative decoding and a mother LDPC code with threshold 
e*, this region extends from to e*. Naturally, to cover a larger 
region, one can choose a mother LDPC code with e* > e*. 
However, such a code may have a lower rate R < R, and 
moreover 77(0) = jzrp- m ay be lower than 77(0) = jztt, 
resulting in a lower throughput in the region e < e* (see 
Figure [TJ. Compare, for example, the rate 1/2 regular (x 2 , x 5 ) 
code with e* = 0.4293 and 77(0) = 0.876 to the rate 2/5 
regular (a; 2 , a; 4 ) code with e* = 0.5176 and 77(0) = 0.829. 

To extend the region of high throughput for a given mother 
code, we propose to augment the HARQ protocol as follows. 
If, after the transmission of all the bits in the codeword, 
decoding still fails, we further increment redundancy simply 
by repeating the same codeword, using the same qi m . Hence, 
each coded bit might be transmitted twice through channels 
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with erasure probabilities and e^ 2 \ At the receiver, both 
received values of a bit are combined together. So, after two 
transmissions, the bit is erased with probability e^M 2 -*. One 
can continue transmitting in this manner, making the scheme 
essentially rateless. 

The proposed protocol is called the incremental redundancy 
protocol with repetition, and we denote it by IR-Rep-HARQ. 
Although repetition is in general not optimal, note that it takes 
place only when the channel conditions are bad (e > e*), 
when it actually is a good strategy to follow. Note that in 
the repetition stage, we can either retransmit the same blocks 
as in the first stage, or determine new blocks, according to 
the optimized fractions {(?;,„}. This translates to generating 
new 9 values in the protocol of Section III-AI We next find 
expressions for the average throughput and the average delay 
for these two cases. 



1) Repetitions of the same blocks 

Assume the IR-Rep-HARQ protocol with repetitions 
of the same blocks during the second transmission of 
the codeword. Denote the channel erasure probabili- 
ties by ejj 1 , ...,e^f for the first transmission and by 
ej 2 , . . . , €jj for the second transmission. Then, similar 
to (Q3 and (fJJ, the average throughput 7?iR-R e p and the 
average delay TiR„R ep are given by 

2 M 



f?IR-Rep 



*EE< 

r— 1 m—1 



,('■) 



2 M 



(23) 



TlR-Rep 



EE^ r) (E 

r— 1 m—1 j — 1 

2 M m 

-EE<4 r) (I» 

r—1 m—1 j — 1 



2 M 

EE 



where q 3 = J2i ^iQij and = Ps(^ii) -PB^m), 
with 



,0) 



Ar) 



(24) 



x(r) ) J2'k=i 9fc ' 



r = l; 
, r = 2. 



(25) 



Or, equivalently, 

r?IR-Rep = I7r=l(l - P B (6$)) + ?7r=2 P B (^ ) ), (26) 

where ry r= i = 77 is given by (Q~|i and 



*E 



,12) 



f/V=2 



M 



m=l j=l 



Similarly, 

r,R- R ep = t(1-P b (<5$)) + 

M m 



At 

E 



-P B (£$), (27) 



Co' 



(2) 



where r is given by (f2]). 
2) Repetition with different blocks 

Assume the IR-Rep-HARQ protocol such that the rep- 
etition of the block m is chosen at random from the 
available, non-repeated bits, according to the fractions 
{<lim}- Then the expressions for r^iR.Rep and riR„R ep are 
the same as in the previous case (see ( 1231 and d24"ii). 
except that the equivalent average erasure probability 



(28) 



with 

m M M M 

^E^E^h E d-*)(E^ 1) )- 

j=l k=l j=m+l fc=l 

We now develop bounds on ?7iR-Rep and t [R.Rep for these two 
IR-Rep-HARQ schemes. 

Theorem 2: The average throughput ?/iR R e p for the IR-Rep- 
HARQ schemes with the same or different repeated blocks is 
bounded by 




?7lR-Rep < < 



r fl(l-e) 
(n) 
R 



€ < € 



1+- 

0, 




(29) 



/e; , < e < 1. 

(n) — 



Proof: Assume M = n. For e < e? % (transmission 
without repetition), the expression for 77 is already given by 
Theorem Q] Consider now e > e? n s (transmission with repeti- 
tion). Let some fraction 7 of bits be sent twice, < 7 < 1. 
Note that sending bits twice is equivalent to sending them 
over a BEC with erasure probability e 2 . Hence the equivalent 
erasure probability p is given by p = (1 — j)e + 7c 2 . 
There are two possible cases to consider. If p > e* n y the 
average throughput ryiR-Rep of the IR-Rep-HARQ scheme is 0. 
If P < e ( n )' *h e avera 8 e throughput is strictly positive and can 
be expressed as 

Rn R 

2^n + (1 — 7)rt 1 + 7 

where 2^n + (1 — 7)71 is the total number of sent bits and Rn 
is the number of information bits. 

Now we find the values of e for which the throughput is 
positive. From the condition p < e?, it follows that 



z (n) 



< 7 < 1. 
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Then the following bounds hold: 




Fig. 4. Upper bound on the throughput for an IR-Rep-HARQ scheme 
based on (x 2 ,x 5 ) LDPC codes (black curve). The straight line above is the 
maximum attainable throughput. 



Thus ?7iR-R ep > when e < J e* n y Moreover, we can upper 
bound ?7iR-Rep in the interval eJs < e 

R 



f?IR-Rep 



1 



< 



7 



1 



The following lower bound on riR.R ep can be derived using 
a similar approach. 

Theorem 3: The average delay riR„R ep for IR-Rep-HARQ 
schemes with the same or different repeated blocks is bounded 
by 



TlR-Rep 




(30) 



As an example, the upper bound on the throughput for the 
scheme based on regular (x 2 ,x 5 ) LDPC codes is shown in 
Fig|4] For simplicity, we assume a large codelength n and 
e (n) ~ e * ■ W e see that, in the region of erasure probabilities 
from e* ss 0.43 to \J1* ~ 0.63, repetition of the same code- 
word results in an almost linear upper bound on throughput. 



Extending the above results to IR-Rep-HARQ schemes with 
a larger number of repetitions is straightforward. We state this 
extension without proof in the following corollary. 

Corollary 1: Consider an IR-Rep-HARQ scheme, based on 
LDPC codes, with L repetitions. Denote by e(r). 



Rim 



R 1 



e -e, 



n , . 



TlR-Rep > < 



loo, 



e < e* (n) for r = 1; 



e(r — 1) < e < e(r) 

for r = 2, . . . , L; 

e > e(L); 

e < e* n) for r = 1; 

e(r — 1) < e < e(r) 

for r = 2, . . . , L; 
e > e(L). 
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B. Comparison with LT Codes 

It is natural to compare the performance of IR-HARQ 
schemes based on punctured LDPC codes with those based 
on other rateless codes. We consider LT codes as an example. 
Since an IR-HARQ-LT scheme does not have a maximum 
number of transmissions M, we assume that M = n for the 
IR-HARQ-LDPC schemes, which leads us naturally to com- 
paring the upper bounds on throughput of the two schemes. 

Assume there are K information bits to transmit. From 
Sec. 5 of |fl9l , the upper bound on throughput of the IR- 
HARQ-LT schemes under belief propagation decoding is given 
by 

f/FC-HARQ < 



1 



1 



log 2 K 



For the IR-HARQ-LDPC schemes, we must choose a code 
rate and a code ensemble. As examples, we take two code 
ensembles already considered in the paper: regular (x 2 ,x 5 ) 
LDPC codes of rate 1/2 and irregular LDPC codes of rate 
0.37, optimized in Section IIV-DI 

Figure [5] presents a comparison of two IR-Rep-HARQ 
schemes and of one IR-HARQ-LT scheme for different values 
of K. Note that in the region of small values of e, the IR- 
HARQ-LDPC schemes have better maximum throughputs than 
the IR-HARQ-LT schemes. Moreover, the throughput of the 
IR-HARQ-LDPC schemes can be improved using repetition 
for e > e*. Finally, for very poor channels (e ps 1), the IR- 
HARQ-LT schemes have a better throughput than the double- 
repetition IR-HARQ-LDPC schemes. 

VI. Discussion and Future Work 

We considered IR-HARQ schemes based on finite-length 
punctured LDPC codes, where the transmission was assumed 
to take place over the time-varying binary erasure channel, 
with the goal to characterize and optimize the throughput and 
the delay obtained by using different puncturing degree distri- 
butions. Our goal was achieved by following two approaches: 
1) approximating the block erasure performance of finite- 
length punctured LDPC codes used in computing the through- 
put and delay and 2) computing an upper (lower) bound on the 
average throughput (delay). We also proposed an optimization 
algorithm for the puncturing degree distribution to improve 
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Fig. 5. Comparison of upper bounds on the thi'oughput of IR-Rep-HARQ- 
LDPC schemes with one repetition, based on regular codes (lower solid 
curves) and on irregular codes (upper solid curves), and of the IR-HARQ-LT 
scheme (dashed curves) with K = 500; 5000; 50000. For IR-Rep-HARQ- 
LDPC, bounds virtually coincide for all K. For IR-HARQ-LT, the lowest 
curve corresponds to the smallest value of K. The dotted line corresponds to 
the maximum theoretical throughput. 



the performance of the IR-HARQ protocol based on LDPC 
codes with finite number of transmissions. We introduced a 
transmission protocol, called Incremental Redundancy HARQ 
with Repetition (IR-Rep-HARQ), which extends the region of 
channel erasure rates over which good performance can be 
obtained with the IR-HARQ scheme. 

There are three main contributions of this paper: 

1) We have defined a cost optimization function that min- 
imizes the delay or maximizes the throughput in the 
case of small feedback overhead (uack)- Optimizing this 
function (if the optimum exists) comes very close to 
achieving the best possible tradeoff between throughput 
and delay. The proposed cost function can be optimized 
point-wise, i.e., for a set of target channel erasure 
probabilities. 

2) We have shown that, from the point of view of per- 
formance optimization, there is an important difference 
between using regular and irregular LDPC codes in 
IR-HARQ schemes. The cost optimization function is 
monotone for regular LDPC codes, and the puncturing 
degree distribution for each of transmissions is simple 
to calculate. For irregular LDPC codes, the cost opti- 
mization function is not monotone, and the puncturing 
degree distributions must be carefully optimized in order 
to obtain the best throughput or delay. 

3) We have deminstrated that each repetition of a complete 
IR-HARQ round upon a failure to decode improves 
the throughput and extends the region of channel era- 
sure probabilities over which good performance can 
be obtained beyond the iterative threshold e* of the 
mother LDPC code. Hence an IR-HARQ scheme based 
on punctured sparse-graph codes can be made rateless 
with a high throughput. In particular, an IR-HARQ 
scheme with repetitions based on punctured LDPC codes 
outperforms an HARQ scheme based on LT codes over 
a large region of channel erasure probabilities. 

It is important to note the following: 



• All protocol stack: Our approximation of Pb can also 
be combined with the reasoning of l20l to obtain a 
more accurate expression of the failure probability, which 
would take into account failure events at all layers of the 
protocol stack. 

• Other types of channels: In principle, our results can be 
extended to other binary-input symmetric memoryless 
channels, thus modeling transmissions at the physical 
layer. In this case the estimation of parameters is more 
involved, but still feasible. As an alternative, they can be 
estimated numerically before the optimization algorithm 
is initiated. 

• Universality of the optimization algorithm: The optimiza- 
tion algorithm is quite general and can be easily adapted 
to other scenarios, e.g., when the packet size varies or 
when feedback is only sent periodically rather than after 
each transmission (see time duplex division schemes in 

ED). 

• Tightness of the approximation: Note that the average 
throughput and the average delay, obtained for given 
p m (x), 1 < m < M, is tight, owing to the tightness of 
the P^" 1 ' approximation. Of course, this approximation 
is valid only for the so called waterfall region of the 
performance curve. However, it is precisely this region 
that is of interest for practical HARQ schemes because 
of the very nature of the protocol. 

The following extensions would be of interest: 

• Accuracy of channel state prediction: It would be of inter- 
est to consider various levels of channel state information 
(CSI) and to obtain the IR-HARQ protocol performance 
in each case. 

• Using other punctured codes: The optimization is not 
limited to LDPC codes. It can be extended to other code 
ensembles for which ther exists a finite-length perfor- 
mance approximation, such as turbo-like codes, which 
could give insight into the design of code ensembles that 
perform well in particular retransmission protocols. 

• Finding the expressions for throughput and delay at each 
network layer: This work can serve as a basis for opti- 
mizing network parameters at any network layer, once 
the expression of the failure probability, based on results 
from 1201 . is available. 

Acknowledgment 

A significant part of this work was done in 2008 at Ecole 
Polytechnique Federate de Lausanne (EPFL). The authors 
would like to thank their EPFL hosts, professors A. Shokrol- 
lahi and R. Urbanke for their support, and also anonymous 
reviewers for helpful remarks and comments. 

References 

[1] Q. Wu and E. Esteves, "The cdma2000 high rate packet data system," in 
Advances in 3G Enhanced Technologies for Wireless Communications , 
J. Wang and T.-S. Ng, Eds. Artech House, 2002, pp. 149-226. 

[2] N. Bhushan, C. Lott, P. Black, R. Attar, Y.-C. Jou, M. Fan, D. Ghosh, 
and J. Au, "CDMA2000 lxEV-DO revision A: a physical layer and mac 
layer overview," IEEE Communications Magazine , vol. 44, no. 2, pp. 
37^49, February 2004. 



13 



[3] D. J. Costello, J. H. Jr., H. Imai, and S. B. Wicker, "Applications of error- 
control coding," Information Theory, IEEE Transactions on , vol. 44, pp. 
2531-2560, October 1998. 

[4] C. Lott, O. Milenkovic, and E. Soljanin, "Hybrid ARQ: theory, state of 
the art and future directions," in ITW'07 , Bergen, Norway, July 2007. 

[5] E. Soljanin, N. Varnica, and P. Whiting, "Incremental 
redundancy hybrid ARQ with LDPC and Raptor codes," 
http://ect.bell-labs.com/who/emina/ 2005, submitted to Information 
Theory, IEEE Transactions on. 

[6] C.-H. Hsu and A. Anastasopoulos, "Capacity achieving ldpc codes 
through puncturing," Information Theory, IEEE Transactions on , vol. 54, 
no. 10, pp. 4698 -4706, oct. 2008. 

[7] M. Levorato and M. Zorzi, "Performance analysis of type ii hybrid ARQ 
with Low-Density Parity-Check codes," in ISCCSP'06 , Malta, March 
2008, pp. 804-809. 

[8] S. Sesia, G. Caire, and G. Vivier, "Incremental redundancy hybrid ARQ 
schemes based on Low-Density Parity-Check codes," IEEE Transactions 
on Communications , vol. 52, no. 8, pp. 1311-1320, August 2004. 

[9] I. Andriyanova and R. Urbanke, "Waterfall region performance of 
punctured LDPC codes over the BEC," in ISIT 2009. IEEE International 
Symposium on , Seoul, South Korea, June 2009. 
[10] E. Soljanin, R. Liu, and P. Spasojevic, "Hybrid ARQ with random 
transmission assignments," in Advances in Network Information Theory , 
P. Gupta, G. Kramer, and A. Wijngarden, Eds. DIMACS Series 
in Discrete Mathematics and Thepretical Computer Science, American 
Mathematical Society, August 2004, vol. 66, pp. 321-334. 
[11] I. Andriyanova and E. Soljanin, "IR-HARQ schemes with finite-length 
punctured LDPC codes over the BEC," in ITW 2009 , Taormina, Sicilia, 
October 2009. 

[12] T. Richardson and R. Urbanke, "Modern coding theory," Cambridge 
University Press, 2008. 

[13] J. Ha, J. Kim, and S. McLaughlin, "Rate-compatible puncturing of Low- 
Density Parity-Check codes," Information Theory, IEEE Transactions 
on, vol. 50, no. 11, pp. 2824-2836, November 2004. 

[14] A. Amraoui, A. Montanari, T. Richardson, and R. Urbanke, "Finite- 
length scaling for iteratively decoded ldpc ensembles," Information 
Theory, IEEE Transactions on , vol. 55, no. 2, pp. 473 -^498, February 
2009. 

[15] A. Dembo and A. Montanari, "Finite size scaling for the core of large 
random hypergraphs," Applied Probability, Annals on , vol. 18, no. 5, 
pp. 1993 -2040, 2008. 

[16] J. Ezri, R. Urbanke, A. Montanari, and S. Oh, "Computing the threshold 
shift for general channels," in ISIT 2008. IEEE International Symposium 
on, July 2008, pp. 1448 -1452. 

[17] C. Di, T. Richardson, and R. Urbanke, "Weight distribution of low- 
density parity-check codes," Information Theory, IEEE Transactions on , 
vol. 52, no. 11, pp. 4839^4855, November 2006. 

[18] A. Amraoui, A. Montanari, T. Richardson, and R. Urbanke, "Finite- 
length scaling for iteratively decoded LDPC ensembles," Information 
Theory, IEEE Transactions on , vol. 55, no. 2, pp. 473^198, February 
2009. 

[19] A. Shokrollahi, "Raptor codes," Information Theory, IEEE Transactions 

on, vol. 52, pp. 2551-2567, 2006. 
[20] A. L. Due, C. L. Martret, and P. Ciblat, "Packet error rate and 

efficiency closed-form expressions for cross-layer hybrid arq schemes," 

in SPAWC'09 , Perugia, Italy, June 2009. 
[21] D. Lucani, M. Stojanovic, and M. Medard, "Random linear network 

coding for time division duplexing: When to stop talking and start 

listening," in INFOCOM 2009, IEEE , april 2009, pp. 1800 -1808. 



